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METHODS AND APPARATUS FOR SUPPORTING AND 



IMPLEMENTING COMPUTER BASED ANIMATION 

Inventors: Philippe Cailloux, Phac Le Tuan, Dan Lipton, Antonio Tuzzi, and 
Jerome Magnier 

Related Applications 

This apphcation is a continuation-in-part of AppUcation Serial No. 
08/891,038; filed July 10, 1997 and claims priority to provisional Application 
Serial No. 60/119,369, filed February 9, 1999. 

BACKGROUND 

Field of the Invention 

The present invention relates to computer-generated animation, and 
more particularly to a system which provides facilities for hierarchical 
decomposition of visual and audio elements within a computer generated 
animation to facilitate editing and creation of the animation. 
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Related Art 

Along with the increasing use of computer-generated animation, a 
number of computer-based animating tools have been developed which allow 
animators to more easily specify and manipulate computer-based animations. 

One particularly cumbersome task is to specify the behavior of large 
groups of independently moving or evolving objects within a computer 
animation. Existing tools for producing computer-generated animation require 
the behavior of individual objects to be specified individually. This can require 
a great deal of time for a large number of objects. Furthermore, much of the 
effort involved in individually specifying the actions of objects is wasted for 
groups of objects, such as a school of fish, which individually exhibit similar or 
predictable behavior. 

Editors for non-animated graphical objects such as the MacDraw 
program, produced by Apple Computer Corporation of Cupertino, Cahfomia, 
allow groups of graphical objects within a graphical image to be combined 
together into a "group." Subsequent editing operations performed on the 
"group" are applied to all elements of the group. For example, if the position of 
an object within a group is changed, corresponding positions for other objects 
within the group are changed in the same way. In another example, if the 
vertical dimension of an object within a group is stretched by a factor of two, 
the vertical dimensions of all other objects in the group are similarly stretched 
in the vertical dimension by a factor of two. This grouping feature of graphical 
editors such as MacDraw can significantly simplify the manipulation of groups 
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of graphical objects within a graphical image. However, such grouping 
operations have so far been appHed only to non-moving graphical images, not 
animations. 

Furthermore, such grouping operations are relatively inflexible in the 
way that objects within a group are modified. In order to edit an attribute of an 
object within a group without editing corresponding attributes of the other 
objects within the group, the group must be "ungrouped," before the object can 
be individually edited, and the objects must subsequently be regrouped. This is 
an awkward and time-consuming process. 

What is needed is an editing tool for creating computer-generated 
animation which allows an original object to be decomposed into a group of 
objects. 

Additionally, what is needed is an editing tool for creating computer- 
generated animation which allows groups of objects to be manipulated 
collectively while providing a flexible method for easily modifying attributes of 
individual objects within the group. 

SUMMARY 

The present invention provides a method and an apparatus for producing 
computer- generated animation which allows an original visual or audio object 
in an animation to be divided into a plurality of sub-objects to be individually 
edited such that the sub-objects inherit characteristics and attributes of the 



Attorney Docket No. 17356-703 
C:\NRPORTBL\PALibl\mp\1138073.1 



-3- 



original object. The invention farther allows sub-objects to be decomposed into 
sub-sub-objects in a hierarchical fashion creating many levels of sub-objects. 

The present invention also allows a collection of objects to be grouped 
together in a flexible way so that a persistent selection mechanism is created for 
the group of objects. This selection mechanism provides for two types of 
modifications of objects within the group. When an attribute of a selected 
object is modified, a first type of modification similarly modifies corresponding 
attributes of other objects in the group. A second type of modification only 
modifies the attribute of the selected object, and does not modify the 
corresponding attributes of other objects in the group. By providing for these 
two types of modifications, the present invention allows the attributes of a 
group of objects to be modified either collectively or individually. These two 
types of modifications may be used to modify a single parameter. For example, 
a first type of modification modifies the color of an object locally, so that it 
modifies only the color of a single object in a group, while a second type of 
modification modifies the color of all objects in the group. 

Thus, the present invention can be characterized as a method for creating 
a display of an object, comprising: decomposing the object into a plurality of 
sub-objects; representing the position of a sub-object as a position of an anchor 
point, and a relative position of the sub-object relative to the anchor point; 
determining the position of the anchor point at a time T; determining the 
relative position of the sub-object at the time T; combining the position of the 
anchor point and the relative position of the sub-object into a position for the 
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sub-object at time T; using this position to construct a graphical representation 
of the object at time T; and outputting the graphical representation to a display 
device. 

According to one aspect of the present invention, sub-objects 
automatically inherit characteristics of the object. 

According to another aspect of the present invention, a plurality of 
graphical displays of the object are created and outputted to the display device 
at a plurahty of sequential points in time to create an animated display of the 
object. 

The present invention may also be characterized as a method for editing 
an object, comprising: decomposing the object into a plurality of sub-objects 
through a user interface, such that the pliirality of sub-objects automatically 
inherit characteristics of the object; and separately editing sub-objects in the 
plurality of sub-objects through the user interface. 

The present invention can also be characterized as a method for editing a 
plurality of objects through a user interface, comprising: displaying a group of 
objects to the user interface; selecting a plurality of objects from the group 
through a user interface; establishing a relationship between the plurality of 
objects, such that, a first type of modification of an attribute of an object 
similarly modifies a corresponding attribute of other objects in the plurahty of 
objects, and a second type of modification of an attribute of an object modifies 
only the attribute of the object, and not corresponding attributes of other objects. 
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According to an aspect of the present invention, the first type of 
modification is performed through a first window in the user interface, and the 
second type of modification is performed through a second window in the user 
interface. 

The present invention can also be characterized as a method for creating 
a visual animation effect, comprising: selecting an original object; dividing the 
original object into a plurahty of sub-objects; animating sub-objects separately; 
after the sub-objects have been separately animated, recombining the sub- 
objects into the original object. 

According to one aspect of the present invention, the method includes 
applying global transformations to the plurality of sub-objects before the 
recombining of the sub-objects into the original object. 

Embodiments of the invention include a web-based computer system for 
animating text, wherein the computer system comprises: a web browser which 
displays a form for entering a text, and one or more icons for representing 
behaviors for the text; a web server coupled to a text animation engine, such 
that the text animation engine includes an object-oriented data structure for 
representing the text, and each character in the text is represented by an object 
in the object-oriented data structure. 

In embodiments of the invention, the web browser resides on a cellular 
phone. In other embodiments, the web browser resides on an electronic 
personal digital assistant. In some embodiments, the web browser resides on a 
web pad, which comprises a wireless device capable of accessing web pages. 
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Embodiments of the invention include methods for applying a behavior 
to an object or a group of objects. In embodiments of the invention, a user may 
drags a behavior icon on top of an object or a group of objects. Embodiments 
of the invention support multiple inheritance. To perform multiple inheritance, 
a user may drag and drop an icon from two or more objects onto a single object. 

Embodiments of the invention include a method of watermarking a 
sequence of animated text, the method comprising: inputting a sequence of text 
characters from a form on a web browser; creating a plurality of objects to 
animate the sequence of text characters, wherein the objects are created on a 
server coupled to the web browser via the Internet; displaying the animated 
sequence of text characters on the web browser, such that a character in the 
sequence is displayed in a manner differing from user specifications; receiving 
electronic payment via the web browser; and redisplaying the animated 
sequence of text characters in response to the payment, such that the animated 
sequence is displayed on the browser in accordance with user specifications. 

Embodiments of the invention include a method of generating a motion- 
blur effect in an animated text character, wherein the animated character is 
displayed in a sequence of frames on a computer screen. In embodiments of the 
invention the method comprises the following steps: selecting a frame from the 
sequence of frames; taking a plurality of sample images for the frame; selecting 
a display feature of the text character for blurring over the plurality of sample 
images; averaging the display feature over the plurality of sample images; and 
displaying the text character in the frame with the averaged feature. In 
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embodiments of the invention the display feature is an RGB value of pixels in 
the plurality of samples. Li alternative embodiments, the display feature is an 
HLS value of pixels in the plurality of samples. In some embodiments the 
display feature is an HIV value of pixels in the plurality of samples. 

An embodiment of the invention includes a method of generating a 
motion blur effect in an animated text sequence. The text sequence may 
include a plurality of characters, such that the animated text sequence is 
displayed in a sequence of frames on a computer display. The computer display 
is coupled to an animation server. In an embodiment of the invention, the 
method comprises creating a first object on the animation server, wherein the 
first object stores a first character in the plurality of characters; creating a 
second object on the animation server, the second object storing a second 
character in the plurality of characters; and blurring the first character on the 
display, wherein the first character is blurred by a blurring function contained in 
the first object. In some embodiments the second character is not blurred. In 
embodiments, the first character is blurred to a degree proportional to its 
velocity. In other embodiments, the first character is blurred in a direction 
corresponding to its path. 

Other aspects and advantages of the present invention can be seen upon 
review of the figures, the description, and the claims which follow. 
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DESCRIPTION OF THE FIGURES 

FIG. 1 is a block diagram illustrating some of the major functional 
components of a computer system containing object editing tool with 
hierarchical decomposition 162 and object data structures 160 in accordance 
with an aspect of the present invention. 

FIG. 2 is a diagram illustrating an example in which a word is 
decomposed into constituent characters, and the characters are individually 
animated in accordance with an aspect of the present invention. 

FIG. 3 is a diagram illustrating how spatial manipulations of an object 
are divided into a set of orthogonal matrix operations in accordance with an 
aspect of the present invention. 

FIG. 4 is a diagram illustrating the data structures used to represent 
audio and visual elements within an animation in accordance with an aspect of 
the present invention. 

FIG. 5 is a diagram illustrating the layout of a graphical user interface 
for creating computer-generated animations in accordance with an aspect of the 
present invention. 

FIG. 6 is a flowchart illustrating the sequence of operations involved in 
decomposing an object into sub-objects and manipulating the sub-objects in 
accordance with an aspect of the present invention. 

FIG. 7 is a flowchart illustrating a special effect which decomposes an 
object into a plurality of sub-objects which are separately animated before 
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recombining into the original object in accordance with an aspect of the present 
invention. 

FIG. 8 is a diagram illustrating the architecture of a web-based 
animation system in accordance with an aspect of the present invention. 

FIG 9. Is an illustration of a data structure used for text-morphing in 
accordance with an aspect of the present invention. 

DESCRIPTION 

The following description is presented to enable any person skilled in 
the art to make and use the invention, and is provided in the context of a 
particular application and its requirements. Various modifications to the 
disclosed embodiments will be readily apparent to those skilled in the art and 
the general principles defined herein may be applied to other embodiments and 
applications without departing fi-om the spirit and the scope of the present 
invention. Thus, the present invention is not intended to be limited to the 
embodiments shown, but is to be accorded the widest scope consistent with the 
principles and features disclosed herein. 

FIG. 1 is a block diagram illustrating a computer system including 
resources to produce a computer-generated animation in accordance with an 
aspect of the present invention. FIG. 1 includes display 100, keyboard 110, 
mouse 120, disk 140 and CPU 170, which are connected together through 
bus 150, which is an I/O bus. CPU 170 additionally connects to memory 130 
through bus 180, which is a faster processor-to-memory bus. Display 100 is a 

Attorney Docket No. 17356-703 
C:\NRPORTBL\PALib l\mp\l 1 38073 . 1 

-10- 



display device, such as a computer monitor, for displaying the computer 
animation. Keyboard 110 and mouse 120 are input devices for accepting user 
input into the computer system. Memory 130 and disk 140 are storage devices 
for storing programs and data for producing computer-generated animations. 
CPU 170 is a central processing unit which: accepts user input from 
keyboard 110 and mouse 120; processes programs and data stored within 
memory 130 and disk 140; and produces output for display 100. Memory 130 
contains object data structures 160, which are data structures corresponding to 
audio and visual objects associated with an animation. Memory 130 
additionally contains an object editing tool with hierarchical decomposition 162, 
which is an editing tool that allows audio and visual objects associated with an 
animation to be hierarchically decomposed and edited to produce an animation. 

FIG. 2 illustrates the decomposition of a word into individual characters 
in accordance with an aspect of the present invention. A graphical object is 
often a natural combination of elementary objects which are themselves 
compound objects. For example, apiece of text is composed of sentences, 
which are themselves composed of words, which are themselves composed of 
individual letters. Other graphical images, such as bit maps, can also be 
arbitrarily decomposed into individual fragments of any shape, such as the 
pieces of a jigsaw puzzle, a tessellation or vectorial objects, which can 
themselves be decomposed into sub-fragments. The rules used to carry out the 
decomposition process depend upon the type of targeted object. 
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Once an object is broken down or divided into elementary objects, 
which can be numerous, it is cumbersome to have to specify a separate behavior 
for each elementary object. It is therefore desirable to distribute the 
characteristics of an original compound object to each elementary object in an 
automatic way that facilitates the widest possible range of effects and yields the 
best performance. 

For example, FIG. 2 illustrates an example of a four-letter word "TEST," 
which starts on a graphical display as object 200 and at a future time ends up as 
translated and rotated object 210 on the display. In order to perform the 
translation and the rotation of object 200, object 200 is first divided into 
individual letters, as is illustrated by the dashed lines surrounding the letters in 
object 200. The coordinates of each letter are specified with relation to an 
anchor point 220. More particularly, the movement from object 200 to 
translated and rotated object 210 can be expressed as a movement of anchor 
point 220 to translated anchor point 230, along with a rotation of the letters 
comprising object 200 can with respect to anchor point 220. By separating the 
translation and rotation of letters comprising object 200 in this way, 
computations for the movement of object 200 are greatly simplified. Note that 
individual letters within object 200 automatically inherit the same anchor 
point 220. 

By separating the translational and rotational components of the motion 
of object 200, a complex set of mathematical calculations is avoided. Without 
the separation into rotational and translational components, the path of a letter 
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within a translating and rotating word is a cycloid, which is typically calculated 
by solving a set of a differential equations, which requires a tremendous amount 
of computation. Furthermore, if the distance of an object to the center of 
rotation also varies in time, the solution of a corresponding set of equation to 
describe the motion of the object becomes quite complex. When the 
translational and rotational components are separated, the path of an individual 
letter within object 200 can be easily expressed as a translation of the anchor 
point, and a rotation about the anchor point, both of which can be calculated 
through simple matrix operations. 

Another interesting effect can be achieved by giving each letter an 
independent anchor point at the geometric center of the letter, about which the 
letter rotates. 

FIG. 3 illustrates how transformations of spatial locations in two 
dimensions can be expressed as a product of five orthogonal 3X3 matrices in 
accordance with an aspect of the present invention. In the top line of FIG. 3, 
transformation matrix M is a product of five separate orthogonal matrices: 
M anchor, M_resize, M_skew, M_rotate and M_translate. Matrix M_anchor 
specifies a translation in both X and Y dimensions for an anchor point. Recall 
that for matrix operations an identity matrix has I's on all of the diagonal 
elements firom the top left-hand comer to the bottom right-hand comer, and has 
O's in all other elements. In the case of matrix M_anchor, there is an additional 
X translation component for translation of the anchor point, on the lower left- 
hand side of the matrix, and an additional Y translation component on the 
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middle column of the bottom row of the matrix. Matrix M resize rescales an 
object in both the X and Y dimensions. Matrix M_ resize includes an X scale 
factor in the upper left-hand comer, and a Y scale factor in the middle of the 
matrix. Matrix M_skew specifies a particular type of rotational warping of an 
object. The matrix M_skew is identical to the identity matrix except that it 
includes an additional Y skew component at the top of the middle column. 
Matrix M_rotate rotates an object by an angle p. Matrix M_rotate includes a 
cos(p) component in the upper right-hand comer, a cos(p) component in the 
middle element, a sin(P) component at the top of the middle column, and a- 
sin(p) component in the middle of the left-hand column. Matrix M_translate 
performs a translation of the object with respect to the anchor point. Like the 
matrix M_anchor, matrix M_translate has I's along the diagonal from the upper 
left-hand comer to the right lower right-hand comer, an X translation element at 
the bottom of the left column, and a Y translation element at the bottom of the 
middle column. Note that the example in FIG. 3 does not include any 
perspective components since the upper element of the right-hand column and 
the middle element of the right-hand column are zero for all the matrices in 
FIG. 3. Also note that when two or more matrices are multiplied together to 
obtain a cumulative result, the transformations of the constituent matrices are 
accumulated. Note that matrix multiplication is not a commutative operation. 
Consequently, the order in which matrices are multiplied can change the result 
of a series of matrix operations. 
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FIG. 4 illustrates the data structures involved in specifying visual and 
audio elements of an animation in accordance with an aspect of the present 
invention. Dynamic array of elements 410 contains a plurality of audio and 
visual elements involved in the animation. In this example, dynamic array of 
elements 410 includes elements 400, 401 and 402. These elements can be 
stored to and subsequently retrieved from a persistent store such as an object- 
oriented database management system. In the embodiment illustrated in FIG. 4, 
an element is a member of a C++ class, which propagates attributes through 
inheritance to other elements derived from the element. In FIG. 4, element 401 
is an audio element, which includes a dynamic array 420 which is associated 
with the audio element. As is shown in FIG. 4, dynamic array 420 includes 
attributes such as volume, stereo pan, chorus, flanger, vibrato, tremelo, high 
filter, band reject, echo and phaser. Other embodiments include other 
commonly known audio attributes. Element 402 is a visual element, which 
includes a dynamic array 430 for visual element 402. Dynamic array 430 
includes visual attributes that can be inherited by descendent objects. These 
attributes include: 

position (in any dimension), 

rotation, 

perspective, 

skew (about any axis), 

scale (about any axis). 
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visibility (yes or no), 

morphing, 

color, 

ink modes (or, xor, transparency, etc.), 

visual effects (blur, sharp, dispersion, spherize, wave, twirl, etc.). 

One embodiment of the present invention includes typographic 
attributes, such as: font size, font name, leading, tracking, Adobe multiple 
master and TrueType GX font variations and attributes, as well as classic 
attributes, such as bold, itaUc, underline, etc. Dynamic array 420 can be 
expanded to accommodate additional visual attributes as required. 

For animation purposes, each attribute within an element is associated 
with an evolution in time, which is a member of an animation class. For 
example, in FIG. 4 element 402 includes an attribute called color which is 
associated with evolution in time 440. Evolution in time 440 provides a linkage 
between a particular time and a particular value. In one embodiment, evolution 
in time 440 is implemented as a function which determines how a color of a 
visual object evolves over time. Every other attribute within element 402 is 
similarly associated with an evolution in time, although some attributes may 
have evolutions that remain static over time. 

FIG. 5 is a diagram illustrating the appearance of a graphical user 
interface display 500 for use in creating and editing an animation in accordance 
with an aspect of the present invention. FIG. 5 includes graphical user interface 
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display 500, which contains Hbrary window 510, composition window 520 and 
synchronization window 530. Library window 5 1 0 is a user interface which 
provides access to a database containing objects to be used in an animation. 
Once an object is selected from library window 510, it can appear in 
composition window 520 and synchronization window 530 for editing. The 
appearance of an object can be edited in composition window 520 for example, 
by changing the color of an object or a group of objects. Other visual attributes 
can also be edited within composition window 520. Synchronization 
window 530 is a user interface which allows movements and attributes of 
different objects to be synchronized in time with each other. 

One aspect of the present invention is a function called "gloup," which 
loosely groups objects together and creates a persistent selection mechanism for 
the group of objects collectively. In one embodiment of the present invention, a 
group may be modified in two ways. When a first type of modification is made 
to an attribute of an object in a group, a corresponding attribute in all other 
objects in the group is similarly modified. When a second type of modification 
is made to an attribute of an item in a group, the modification only applies to the 
selected object. For example, in one embodiment, as is illustrated in FIG. 5, 
when a change is made to any object of a group in synchronization window 530, 
the change applies only to that object. In contrast, when a change is made to an 
object of a group in composition window 520, then the change applies to all 
other objects in the group. In another example, if an anchor point is changed in 
the composition window 520, the change appUes to all objects. Whereas, if a 
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change is made to the anchor point in the synchronization window 530, the 
change only applies to one object. Finally, any viewing preference selected for 
an object in a group will apply to all objects in the group. The present invention 
greatly enhances productivity by allowing both collective and individual 
changes to be made through different windows without time-consuming 
ungrouping and grouping operations. 

In another embodiment, a certain set of attributes are group attributes, 
for which any changes made to an individual object affect the entire group. 
Another group of attributes are individual attributes, for which changes made to 
an individual object do not affect other objects in the group. This type of a 
grouping feature does not require two separate windows. If a group attribute is 
modified, all other elements in the group are similarly modified. When an 
individual attribute is modified, only the attribute of the individual object is 
changed. 

FIG. 6 is a flowchart illustrating the sequence of steps involved in 
decomposing and recombining an object to create animation effects in 
accordance with an aspect of the present invention. The system starts at 
step 600 which is a start state. The system next advances to step 602. At step 
602, the object is decomposed into a plurality of sub-objects. The system next 
advances to step 604. At step 604, sub-objects are represented as a position of 
an anchor point, and a relative position of the sub-object. The system next 
advances to step 606. At step 606, the system determines the position of the 
anchor point at time T. The system next advances to step 608. At step 608, the 
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system determines a relative position of a sub -object relative to the anchor point 
at time T. The system next advances to step 610. At step 610, the system 
combines the position of the anchor point, and the relative position of the sub- 
object at time T. For example, in the case of a system which uses matrix 
operations, the combination process includes multiplying a matrix representing 
an anchor point with a matrix representing a position of the sub-object relative 
to the anchor point. The system next advances to step 612. At step 612, the 
sub-objects are recombined to construct a graphical representation of the 
original object at time T. The system next advances to step 614. At step 614, 
the system outputs the graphical representation to a display. The system next 
advances to step 616 which is an end state. This process is iteratively repeated 
to create a sequence of graphical images comprising an animation. 

The method for representing a sub-object as a position of an anchor 
point and a position of the sub-object relative to the anchor point can be 
generalized for other attributes besides position. For example, consider the 
attribute of color. An object may be decomposed into sub-objects, each of 
which inherit a baseline color intensity value representing a level of ambient 
lighting, which changes as a function of time. The sub-objects themselves may 
vary in color, for example, however this color variance is relative to the 
changing baseline color intensity value. 

FIG. 7 is a flowchart illustrating the sequence of operations involved in 
creating an animation effect in accordance with an aspect of the present 
invention. The system starts at step 700 which is a start state. The system next 
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advances to step 702. At step 702, the system selects an original object to be 
decomposed. In one embodiment, this selection is performed automatically by 
the system. In another embodiment it is accomplished by obtaining user input 
from a user interface. The system next advances to step 704. At step 704, the 
system divides the original object into a plurality of sub-objects. This division 
may be accomplished automatically by the system or it may be accomplished by 
accepting input from a user interface. The system next advances to step 706. 
At step 706, the system animates sub-objects separately. For example, the sub- 
objects may proceed along different paths. The system next advances to 
step 708. At step 708, the system recombines the sub-objects into the original 
object. The system next advances to step 710 which is an end state. The above- 
mentioned sequence of operations produces an interesting visual effect in which 
an object can be divided into sub-objects which fly apart and follow their own 
paths to eventually recombine into the original object. 

Applications of the Object Decomposition Technology 

I. Browser-Based Text Animation Design 

The present invention may be used to enable users to create text 
animation via web browsers. The architecture of the web based text animation 
system is illustrated in FIG 8. A web browser 800 is accessed by a user. The 
web browser accesses a web server 804 via the Internet 802. The web server 



Attorney Docket No. 17356-703 
C:\NRPORTBL\PALib 1 \mp\l 1 38073 . 1 



-20- 



804 is coupled to a text animation engine 808 that enables the user to create the 
text animation. 

To faciHtate the animation of text by the widest number of Internet 
users, the creation of the animated text should be as efficient as possible. A 
user should be able to animate text via the browser 800, preferably by 
performing no more than one mouse cHck per animation created. Moreover, the 
animation system should not require the installation of a plug-in to the browser 
800. The browser-base text animation tool should also address the following 
issues: 

• The tool should separate the description of the animation fi-om the text to 
which the animation is applied (text object); 

• The tool should describe the animation in a way that is independent of the 
content of the text object; 

• The tool should define the parts of the animation that can be controlled by 
the user for a given animation. 

• The tool should take into account the relative torpor of Internet connections 
in the design process. 

The facilitation of web-based text animation also introduces secondary 
considerations which merit attention, such as: 

• The visual representation of the desired animation description should ease 
the creation of animated text by a user. 
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• The system should be capable of applying an existing text animation 
example to a new text object with a different number of characters or words; 

• The system should include a process to adapt the time component of the 
animation depending on the number of characters of the text object; 

• The system should extend to non-alphabetical languages such as Kanji or 
Chinese characters. 

An embodiment of the invention address the issues listed above as 
follows: 

a. A behavior (called a Dance) is represented by a separate icon 
appearing on the web browser 800, and can be manipulated by the user as a 
separate object. The icon 806 can be manipulated on the browser 800 by drag- 
and-drop and cut-and-paste, and may be stored on a library of behaviors, or 
"Dances", via a window 810 appearing on the browser. 

b. To apply a behavior to an object or a group of objects, the user simply 
drags a Dance icon 806 on top of the object or the group of objects (if these 
objects have been first included in the same "Group"). To perform multiple 
inheritance, the user simply drags and drops the Dances icon from two or more 
objects onto a single object. For example, an object A could inherit its motion 
path from an object B and its rotation along that path from an object C. 

c. As an object receiving a behavior, or "Dance" may not have the same 
Hfespan as the object that bore the original Dance, the various key frames of the 
original Dance should be adapted to the hfespan of the receiving object. The 
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system presents several options to the user which emphasize different aspects of 
the Dance according to the user's preferences. 

d. The concept is extended to the web by enabUng the apphcation of a 
Dance object to any text string entered by the user in an HTML form via the 
browser 800. The text strings are combined in a Template to create a 
customized animated text, which may be an ad banner, greeting card, postcard, 
business card, or other form of text. 

e. The text animation engine resides on the Web server 804 and can 
operate without requiring the user to download any code or plug-in. It is 
designed to work with devices such as cell phones, palm computing devices, or 
any device capable of accessing the web through an embedded browser 800. 

II. Dynamic Creation of an Animated Watermark 

Dynamic Media Objects (DMOs) are used more and more widely to 
improve the user experience on a web site. Companies that sell Dynamic Media 
Objects have to protect themselves from the theft of these objects one they are 
displayed on a web page. 

As it is not practical to prevent customers from copying DMOs 
displayed on the screen at any point in time, companies have been seeking ways 
to include a watermark in the DMOs in order to render them unusable for 
purposes other than demonstrations, or to facilitate authentication of stolen 
samples. 
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The problem addressed here is related to the situation where the DM0 is 
customized with the viewer's information but is not to be copied by the viewer 
until some form of payment has been properly performed. It is necessary, 
however, to show a sample version of the DMO in a way that would entice the 
viewer to buy it. 

If the watermarking process is too visible (or "obnoxious"), it might 
defeat the purpose of attracting the customer with high-quality customized 
content by interfering with the design integrity of the content. If the 
watermarking is too subtle, then it might not be enough of a deterrent to prevent 
illicit copies. 

Existing methods for adding a watermark are based on encryption 
mechanisms and are compute intensive in order to increase the cost of 
tampering efforts. This heavy approach is not necessary for customized 
products which are created "just-in-time," as the process of creating the product 
provides an opportunity to embed watermark information in the product in a 
more effective way. 

Several issues must be resolved when trying to protect an animated 
image with a watermark: 

• The resulting image should still be useful for the viewer, enabling the 
user to have an accurate idea of what then end result might be, when the 
watermark is removed. Only then can it be expected that the user will buy the 
sample. 
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• A visual watermark in a DM0 should not interfere with objects and 
colors used in the DMO. If the types of images vary widely, it can become 
quite difficult to ensure that a particular watermark will not hide a key element 
that the viewer wants to verify before they buy. 

• It should be difficult for the viewer to remove that watermark on his 
own. Indeed, it should be more costly for the viewer to try to circumvent the 
trademark than to purchase it directly. 

Embodiments of the present invention allow the creation of a dynamic 
watermark by modifying a portion of the animated elements used in the 
Dynamic Media Object. The modifications are minor and do not fundamentally 
change the altered object but are sufficiently visible to prevent a commercial use 
of the result. 

Examples: 

In an embodiment of the invention, animated text objects may be altered 
by replacing certain characters by a visibly different character of similar size or 
shape, in order to avoid altering the overall perception of the animated object. 

In alternative embodiments, a graphic object might be altered by 
changing one sub-element in a way that is immediately apparent, without 
perturbing the animation of the full object. For instance, the head of an 
animated character could be replaced by a colored oval during the whole 
animation sequence, and this would serve as a watermark. 

The embodiments described above meet the criteria listed for 
watermarks, as: 
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• The resulting animation is still useful and recognizable by the viewer. 

• By altering the objects in place, the watermarking method avoids 
running into the problem of obfuscating elements of importance to the viewer. 

• As the alteration impacts all frames, it would require the 
unscrupulous user to fastidiously correct each frame individually in order to get 
rid of the watermark, and in many instances, the cost would be prohibitive 
compared to the benefit of obtaining the Dynamic Media Object without paying 
for it. 

III. True Velocity Motion-Blur Method 

To create animations with the appearance of "realism", animations 
should reproduce the imperfections of the real world, including the replication 
of perception based on the limitations of the past or existing technologies. For 
example, motion blur occurs automatically in a photograph of a fast moving 
object if the shutter speed is slow enough. As a result, observers associate 
speed with motion-blurred images, and motion-blurred images are desirable to 
depict speed in animations. 

An embodiment of the invention includes a method for automatically 
determining the motion-blur effect from the actual velocity and actual motion 
path of each object during the animation. A fast-moving object will 
automatically have a longer trail than a slow moving object, and the trail will 
automatically take the shape of the path along which the object has traveled. 
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The designer does not have to manually recreate the blurring effect object by 
object, and frame by frame. 

In order to create a motion-blur effect, it is necessary to render each 
individual frame of an animation with information about the past instances of 
each object. The key problem is to determine the appropriate number of past 
instances to include in the computation. The creation of the motion-blur effect 
involves the resolution of the following issues: 

• What is the length of the motion blur effect? 

• What is the direction of the motion blur effect? What if the object 
moves along a curve in a rapid movement? In such a case, the frail 
should hug the actual path followed by the objective. 

• How can the blurring effect be applied to attributes other than spatial 
attributes, such as color, fransparency, etc.? 

An embodiment of the invention includes a solution based on the 
concept of simulating the actual phenomenon of taking a photograph with a 
slow shutter speed. For a shutter speed of say 1/1 0th of a second, and an 
animation at 30 frames per second, the motion blur will include three samples 
per frame. 

The actual rendering of an object is then calculated by averaging the 
value of each pixel of the image from the values of the pixel in each of the three 
frames, and by hmiting the calculation to the bounding box within which the 
object has evolved during the time the virtual shutter was open. Such averaging 
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can be made with the RGB value of each pixel or by using any other color 
model, such as HLS, HIV or others. 

The method is not limited to suing a linear average of the various 
samples, and can be extended to include any type of averaging, for example by 
giving a more important weight to the most recent sample, in order to simulate a 
faster faxing effect. One key advantage of this approach is to enable the 
rendering of a blurring effect due to the rapid change of color of a particular 
object, even if the object is positionally static. In other words, this method 
enables rendering of color blurring, transparency blurring, etc... 

When applied to rapidly changing text elements (as in Rapid Serial 
Visuahzation Process, or RSVP, a particular method of Kinetic Typography), 
this blurring method enables additional effects akin to morphing: If a letter A is 
quickly replaced by a succession of letters such as B,C,D, then the rendering of 
the letter will display a blurring effect due to the shape differences of that set of 
characters. This effect is referred to as typographic blurring. 

The issues listed earlier are solved naturally with this approach: 

• The length of the motion blue effect is automatically computed jfrom 
the speed of motion of the object, the nimiber of frames per second 
for the animation, and the shutter speed of the virtual camera. 

• The direction of the blurring effect is automatically rendered 
accurately because of the computation of the actual position of the 
object over time. 
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• The blurring effect can be applied to any visual parameter that 
evolves in time during the animation. 

IV. Legibility Enhancing Text Morphine Method 

Embodiments of the invention support the morphing of text elements. 
In order to provide the best visual effect, it is important for the morphing 
process to keep the text legible as long as possible, even though it is distorted. 
Similarly, once the midpoint in the morphing process is crossed, it is important 
to for the text to become legible as soon as possible before the distorted text 
comes to its final form. 

The difficulty of morphing characters comes fi-om the desire to keep the 
morphed text legible as long as possible while the morphing operation takes 
place. In order to create the best possible visual effect, it is important to be able 
to determine automatically how best to pair morphing points firom the start 
character to the end character. 

To morph characters legibly, the following challenges need to be 
addressed: 

• If the start character has a different number of shapes than the end 
character, the distortion of the original character may be dramatic 
very quickly and the start character will be imreadable very quickly. 

• Each pair of characters has a different best inter-morphing sequence, 
and it is not easy to establish an automatic algorithm to find the best 
solution in each case. 
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A solution to the challenges listed above is illustrated schematically in 
FIG. 9. Embodiments of the invention define a data structure 900 that is 
attached to each possible pair of characters within a font family 902. The data 
structure will define how each pair of characters can best morph into each other. 
In an embodiment of the invention, each pair of characters in the font family 
902 is associated with an element 904 in the data structure 900 specifying an 
inter-morphing sequence. The data structure may be created directly by the font 
designer, or can be defined later on through a separate process for each existing 
font family. A data structure attached to a pair of characters within a font can 
also be used for two characters from an unprocessed font (i.e., a font which does 
not define how characters morph into each other) as a best-guess default 
information. 

The legibiUty of the characters during the morphing sequence depends 
on parameters defining the start and end characters for the purpose of the 
morphing algorithm such as: relative positions, relative rotation angle, 
characteristic mapping. Because of this approach, the number of combinations 
to process in order to find the best morphing path is significantly reduced while 
consistently ensuring the best legibility during the process. 

The foregoing description of embodiments of the invention have been 
presented for purposes of illustration and description only. They are not 
intended to be exhaustive or to limit the invention to the forms disclosed. 
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Obviously, many modifications and variations will be apparent to practitioners 
skilled in the art. 
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What Is Claimed Is: 



1 1 . A web-based computer system for animating text, the computer 

2 system comprising: 

3 a web browser, the web browser including 

4 a form for entering a text, the text including a pluraUty of 

5 characters; 

6 one or more icons for representing behaviors for the text; 

7 a web server, the web server coupled to a text animation engine, 

8 the text animation engine including an object-oriented data 

9 structure for representing the text, such that the object-oriented 

1 0 data structure includes a plurality of objects, wherein each 

1 1 character in the text is represented by an object in the plurality 

12 of objects. 

1 2. The computer system of claim 1 , wherein the web browser 

2 resides on a cellular phone. 

1 3. The computer system of claim 1, wherein the web browser 

2 resides on an electronic personal digital assistant. 

1 4. The computer system of claim 1, wherein the web browser 

2 resides on a web pad, the web pad flirther comprising a wireless 

3 device capable of accessing web pages. 
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1 5. The computer system of claim 1, wherein an icon from the one 

2 or more icons may be dragged onto a token for an object 

3 representing a character in the text, such that a behavior 

4 represented by the icon is transferred to the object. 

1 6. The computer system of claim 1 , wherein two or more icons may 

2 be dragged onto a token for an object representing a character in 

3 the text, such that behaviors represented by the two or more 

4 icons are transferred to the object. 

1 7. The computer system of claim 1 , wherein an icon for a behavior 

2 may be dragged onto two or more tokens, wherein each of the 

3 two or more tokens represents an object from the plurality of 

4 objects, such that the behavior is transferred to each of the 

5 objects. 

1 8 . A method of animating a text sequence by use of a web browser, 

2 the method comprising: 

3 entering a text sequence into a form on the web browser, the text 

4 sequence comprising an ordered sequence of characters; 

5 creating a plurality of objects in a server coupled to the Internet, 

6 wherein each character in the sequence of characters is 

7 represented by an object in the plurality of obj ects; 
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8 displaying one or more icons on the web browser, wherein the 

9 one or more icons represent potential behaviors for the plurality 
10 of objects. 

1 9. The method of claim 8, further comprising: 

2 dragging a first icon from the plurahty of icons onto a first token 

3 for a first object in the plurality of objects, wherein the first 

4 object corresponds to a first character in the sequence of 

5 characters, such that a first behavior represented by the first icon 

6 is transferred to the first object. 

1 10. The method of claim 9, further comprising: 

2 dragging a second icon from the plurality of icons onto the first 

3 token, wherein a second behavior represented by the second icon 

4 is transferred to the first object. 

1 11. The method of claim 1 0, wherein the first behavior is rotation. 

1 12. The method of claim 1 1 , wherein the second behavior is motion 

2 along a path. 

1 13. The method of claim 9, wherein the first behavior is 

2 automatically applied to a second object, wherein the second 

3 object corresponds to a second character in the sequence of 

4 characters. 

1 14. A method of watermarking a sequence of animated text, the 

2 method comprising: 
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3 inputting a sequence of text characters from a form on a web 

4 browser; 

5 creating a plurality of objects to animate the sequence of text 

6 characters, wherein the objects are created on a server coupled to 

7 the web browser via the Internet; 

8 displaying the animated sequence of text characters on the web 

9 browser, such that a character in the sequence is displayed in a 

1 0 manner differing from user specifications; 

1 1 receiving electronic payment via the web browser; 

12 redisplaying the animated sequence of text characters in response 

13 to the payment, such that the animated sequence is displayed on 

14 the browser in accordance with user specifications. 

1 1 5. A method of morphing text characters on a computer display, the 

2 method comprising: 

3 selecting a start character, wherein the start character is selected 

4 from a plurahty of characters in a font family; 

5 selecting an end character from the font family; 

6 accessing a data structure for the font family, the data structure 

7 containing an inter-morphing sequence for each pair of 

8 characters in the font family, such that the inter-morphing 

9 sequence for the start character and the end character is selected 

1 0 from the data structure. 
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1 1 6. The method of claim 15, further comprising: 

2 morphing the start character into the end character according to 

3 the inter-morphing sequence for the start character and the end 

4 character. 

1 17. The method of claim 1 5 , wherein the data structure is used as a 

2 default for a second font family. 

1 1 8 . A method of generating a motion-blur effect in an animated text 

2 character, wherein the animated character is displayed in a 

3 sequence of frames on a computer screen, the method 

4 comprising: 

5 selecting a frame from the sequence of frames; 

6 taking a plurality of sample images for the frame; 

7 selecting a display feature of the text character for blurring over 

8 the plurality of sample images; 

9 averaging the display feature over the plurality of sample 

10 images; 

1 1 displaying the text character in the frame with the averaged 

12 feature. 

1 1 9. The method of claim 1 8, wherein the display feature is an RGB 

2 value of pixels in the plurality of samples. 

1 20. The method of claim 18, wherein the display feature is an HLS 

2 value of pixels in the plurality of samples. 
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1 21. The method of claim 1 8, wherein the display feature is an HIV 

2 value of pixels in the plurality of samples. 

1 22. The method of claim 1 8, wherein the display feature is a color 

2 model of pixels in the plurality of samples. 

1 23 . A method of generating a motion blur effect in an animated text 

2 sequence, the text sequence including a plurality of characters, 

3 wherein the animated text sequence is displayed in a sequence of 

4 frames on a computer display and the computer display is 

5 coupled to an animation server, the method comprising: 

6 creating a first object on the animation server, the first object 

7 storing a first character in the plurality of characters; 

8 creating a second object on the animation server, the second 

9 obj ect storing a second character in the pliirality of characters; 

1 0 blurring the first character on the display, wherein the first 

1 1 character is blurred by a blurring function contained in the first 

12 object. 

1 24. The method of claim 23 , wherein the second character is not 

2 blurred. 

1 25 . The method of claim 24, wherein the first character is blurred to 

2 a degree proportional to its velocity. 

1 26. The method of claim 25, wherein the first character is blurred in 

2 a direction corresponding to its path. 
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METHODS AND APPARATUS FOR SUPPORTING AND 



IMPLEMENTING COMPUTER BASED ANIMATION 
ABSTRACT 

5 The present invention provides a method for hierarchically decomposing 

a visual or audio object within an animation into plurality of objects which can 
be individually edited to achieve particular animation effects. For example, a 
graphical object may be decomposed into a plurality of graphical sub-objects, 
each of which is inherits an anchor point from the original object, or is given an 

10 original anchor point distinct from the original object. Each sub-object also 
includes a relative position for the sub-object relative to the anchor point. The 
path of the anchor point is combined with relative positions of the sub-objects to 
produce an animation for the object as a whole. This decomposition technique 
can greatly increase computational efficiency of an animation. It also provides 

15 for inheritance of attributes between objects and descendent sub-objects. The 
objects may support fimctions, or behaviors, such as morphing or motion 
blurring. The present invention additionally provides a flexible grouping 
operation to facilitate modifications to a group of objects. When a first type of 
modification is made to an attribute of an object in a group, this change is 

20 apphed to corresponding attributes of other objects in the group. When a 

second type of modification is made to an attribute of an object in a group, the 
change only applies to the selected object or objects, and not to other objects in 
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the group. The present invention allows objects to be manipulated on servers 
which are connected to a display via the Internet. 
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known to that individual to be material to patentability as defined in this section.... The duty to 
disclose all information known to be material to patentabihty is deemed to be satisfied if all 
information known to be material to patentability of any claim issued in a patent was cited by the 
Office or submitted to the Office in the manner prescribed by §§ 1 .97(b)-(d) and 1.98." 

I hereby claim foreign priority benefits under Titie 35, United States Code, §119 of any 
foreign apphcation(s) for patent or inventor's certificate as indicated below and have also identified 
below any foreign application for patent or inventor's certificate having a filing date before that of the 
application on which priority is claimed: 

Prior Foreign Application(s): Priority Claimed 



(Number) (Country) (Day/MonthA^ear Filed) Yes No 



(Number) (Country) (Day/Month/Year Filed) Yes No 
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I hereby claim the benefit under Title 35, United States Code, §120 of any United States 
application(s) hsted below and, insofar as this is a continuation-in-part application filed under the 
conditions set forth in 35 United States Code, §120, which discloses and claims subject matter in 
addition to the prior copending application(s) listed below, I acknowledge the duty to disclose to the 
United States Patent Office all information known to be material to patentability as defined in Title 
37, Code of Federal Regulations, §1 .56 which became available between the filing date of the prior 
application and the national or PCT international filing date of this application: 

7/10/97 Pending 



(Application Serial No.) (Filing Date) (Patented, Pending, Abandoned) 

60/119.369 2/9/99 Pending 

(Application Serial No.) (Filing Date) (Patented, Pending, Abandoned) 



I hereby appoint the following attomey(s) and/or agent(s) to prosecute this application and 
transact all business in the Patent and Trademark Office connected therewith, and to file, prosecute 
and to transact all business in connection with international applications directed to said invention: 

Paul Davis 29,294 

John J. Bruckner 35,816 

DavidJ. Weitz 38,362 
Kent R. Richardson 39,443 

Barbara Courtney 42,442 

Richard L. Gregory, Jr. 42,607 
Van Mahamedi 42,828 
ShantanuBasu 43,318 
Steven Warhola 43,237 
X. Shirley Chen 44,608 
Joel Harris 44,743 
ShaaluMehra 44,934 

Address all correspondence to: 

Shaalu Mehra 

Wilson, Sonsini, Goodrich & Rosati 
650 Page Mill Road 
Palo Alto, CA 94304 

Direct all telephone calls to Shaalu Mehra at (650) 493-9300. 



I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and beUef are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the like so made are punishable by 
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fine or imprisonment, or both, under Title 18, United States Code, §1001 and that such willful false 
statements may jeopardize the validity of the appUcation or any patent issued thereon. 

Full name of sole or 

first inventor: Phillipe Cailloux 

Inventor's signature: . 

Date: . ^ 

Citizenship: French . 



Residence: Sunnyvale. CA 



Post Office Address: Same as above 



Full name of second joint 
inventor, if any : : Phac Le Tuan 

Inventor's signature: 

Date: 

Citizenship: U.S.A. 



Residence: San Jose. CA 



Post Office Address: Same as above. 



Full name of third joi 
inventor, if any:: 

Inventor's signature: 

Date: 

Citizenship: 
Residence: 
Post Office Address: 



Dan Lipton 



U.S.A. 

San Francisco. CA 
Same as above. 



Full name of fourth joint 
inventor, if any: : Antonio Tuzzi 

Inventor's signature: 

Date: 

Citizenship: Italian 

Residence: Sunnyvale. CA 

Post Office Address: Same as above. 
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Full name of fifth joint 

inventor, if any:: Jerome Magnier 

Inventor's signature: ^ ^ 

Date: 

Citizenship: French _ 

Residence: Paris. France . _ 

Post Office Address: Same as above. ^ 
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